DiscoverOvercommitted | Software Engineering and Programming InsightsClosed That Tab: What "How Complex Systems Fail" Teaches Software Engineers
Closed That Tab: What "How Complex Systems Fail" Teaches Software Engineers

Closed That Tab: What "How Complex Systems Fail" Teaches Software Engineers

Update: 2026-09-29
Share

Description

Closed That Tab is back. Erika finally read Richard Cook's How Complex Systems Fail, an 18 point paper Cook wrote with patient safety and medical systems in mind, but one that is frequently discussed in web development and software engineering since the foundational principles apply universally. Erika and Bethany work through what holds up in practice.


They cover the difference between normal failure and catastrophic failure, why knowing your system's baseline is its own skill, and why fixes are never free: every change adds complexity, knowledge gaps, and new risk. They get into safety as a set of defensive actions, including rate limiting, caching, rollback plans, feature flags, backups, playbooks, and watching for drift. Then they take on Cook's most contested claim, that root cause analysis is fundamentally wrong for complex systems, and where they agree and disagree. Bethany makes the case that incident reviews are still one of the best learning tools available, as long as psychological safety comes first.


The conversation also digs into hindsight bias and self-blame, the difference between taking accountability and taking blame, practitioners as both the risk and the defense in a system, why training and safety work are chronically undervalued, where AI helps during an incident and where you still need a human expert, practicing failure through game days and shadowing, and keeping on-call sustainable so you do not burn out the people holding the pager.


Hosts

  • Overcommitted: https://overcommitted.dev
  • Bethany Janos: https://www.trustyduck.dev
  • Erika Eggemeyer: https://github.com/eggyhead


Links

  • How Complex Systems Fail by Richard Cook: https://www.adaptivecapacitylabs.com/HowComplexSystemsFail.pdf
  • Thinking In Systems: https://www.chelseagreen.com/product/thinking-in-systems/


Comments 
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Closed That Tab: What "How Complex Systems Fail" Teaches Software Engineers

Closed That Tab: What "How Complex Systems Fail" Teaches Software Engineers

overcommitted.dev | Women in Tech and Tech Mentorship